Skip to content

Conversation

@pan-x-c
Copy link
Collaborator

@pan-x-c pan-x-c commented Oct 31, 2025

Description

As the title says

Checklist

Please check the following items before code is ready to be reviewed.

  • Code has passed all tests
  • Docstrings have been added/updated in Google Style
  • Documentation has been updated
  • Code is ready for review

@gemini-code-assist
Copy link
Contributor

Summary of Changes

Hello @pan-x-c, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request primarily focuses on releasing version "0.3.2" of the Trinity-RFT project. It involves updating the internal version numbers in the pyproject.toml and trinity/__init__.py files, as well as updating the project's documentation to reflect this new release. The documentation changes include adding a news entry for v0.3.2 and modifying installation instructions to either remove version pinning or update the pinned version, ensuring users can easily access the latest stable release.

Highlights

  • Version Update: The project version has been bumped to "0.3.2" across configuration and source files.
  • Documentation Updates: The README.md and README_zh.md files have been updated to announce the v0.3.2 release in their news sections.
  • Installation Instructions Refinement: English documentation and tutorials now suggest installing trinity-rft without a specific version pin. The Chinese README_zh.md updates the pinned version from 0.3.1 to 0.3.2, while the Chinese installation tutorial (docs/sphinx_doc/source_zh/tutorial/trinity_installation.md) removes version pinning.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request bumps the project version to 0.3.2 and updates the documentation accordingly. The version updates in pyproject.toml and trinity/__init__.py are correct. However, there are inconsistencies in the installation commands across the documentation files. While README_zh.md correctly pins the installation to version 0.3.2, other files like README.md and the installation guides in docs/ have removed the version pinning. For clarity and to prevent potential issues for users, it's best to consistently pin the version to 0.3.2 in all installation examples. I've added specific suggestions to address this.

@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 3, 2025

/unittest-all

@github-actions
Copy link

github-actions bot commented Nov 3, 2025

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
171 165 3 3 0 0 1h 12m

Failed Tests

Failed Tests ❌ Fail Message
❌ tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter The test failed in the call phase
❌ tests/common/vllm_test.py::TestModelLen_0::test_model_len The test failed in the call phase due to an assertion error
❌ tests/common/vllm_test.py::TestModelLen_1::test_model_len The test failed in the call phase due to an assertion error

Skipped

Tests Status
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer skipped ⏭️

Tests

Test Name Status Flaky Duration
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_std_grpo 41ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_duplicate_grpo 5ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_advantage 3ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_correct_bias 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_reward_std 1ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_advantage 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_dpo_policy_loss 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_gspo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_mix_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_opmd_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_ppo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_sft_policy_loss 1ms
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline 19.4s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation 15.6s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer 4.1s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft 5.8s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo 6.4s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader 153ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer 4.2s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter 529ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter 468ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter 741ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter 1.1s
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter 732ms
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter 230ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse 8.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity 4.7s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control 6.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue 5.6s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue 5.6s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity 6.5s
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage 6ms
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_buffer_read_write 5.0s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0 179ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1 158ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2 158ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3 162ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4 178ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0 68ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1 3.9s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2 47ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3 4.1s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4 48ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5 4.7s
tests/cli/launcher_test.py::TestLauncherMain::test_debug_mode 46.3s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_command 7.3s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_in_dlc 1.4s
tests/cli/launcher_test.py::TestLauncherMain::test_main_studio_command 337ms
tests/cli/launcher_test.py::TestLauncherMain::test_multi_stage_run 1.8s
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 32.4s
tests/common/config_test.py::TestConfig::test_config_flatten 39ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 185ms
tests/common/config_test.py::TestConfig::test_default_workflow 88ms
tests/common/config_test.py::TestConfig::test_load_default_config 3.5s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly 89ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster 353ms
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion 15ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 43.8s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 32.5s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 44.3s
tests/common/vllm_test.py::TestModelLen_0::test_model_len 17.7s
tests/common/vllm_test.py::TestModelLen_1::test_model_len 17.4s
tests/common/vllm_test.py::TestAPIServer::test_api 22.4s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async 23.0s
tests/common/vllm_test.py::TestTokenizer::test_action_mask 241ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools 228ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 19.6s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 17.4s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer 1m 16s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer 55.2s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer 3m 36s
tests/explorer/explorer_test.py::ServeTest::test_serve 1m 20s
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow 13.0s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations 12.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results 30.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution 12.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow 12.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods 22.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop 23.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks 15.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid 12.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all 15.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch 21.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0 2ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1 602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1 1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps 1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow 16ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow 24ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow 265ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow 4ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow 16ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow 10ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow 78ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1 102ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1 201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow 14.6s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow 14.6s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter ⏭️ 1ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner 298ms
tests/manager/synchronizer_test.py::TestSynchronizerExit::test_synchronizer 1m
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_0::test_synchronizer 1m 43s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_1::test_synchronizer 1m 48s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_2::test_synchronizer 2m 33s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_3::test_synchronizer 2m 32s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_0::test_synchronizer 1m 44s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_1::test_synchronizer 1m 44s
tests/service/data_juicer_test.py::TestDataJuicer::test_config 1.3s
tests/service/data_juicer_test.py::TestDataJuicer::test_server_start 21.6s
tests/service/data_juicer_test.py::TestDataJuicerExperiencePipeline::test_data_juicer_operators 30.7s
tests/service/data_juicer_test.py::TestDataJuicerTaskPipeline::test_data_juicer_task_pipeline 14.4s
tests/trainer/trainer_test.py::TestTrainerCountdown_0_fsdp::test_trainer 2m 51s
tests/trainer/trainer_test.py::TestTrainerCountdown_1_megatron::test_trainer 5m 10s
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer 1m 22s
tests/trainer/trainer_test.py::TestTrainerGSM8K_0_fsdp::test_trainer 1m 19s
tests/trainer/trainer_test.py::TestTrainerGSM8K_1_fsdp2::test_trainer 1m 17s
tests/trainer/trainer_test.py::TestTrainerGSM8K_2_fsdp::test_trainer 1m 19s
tests/trainer/trainer_test.py::TestTrainerGSM8K_3_fsdp2::test_trainer 1m 29s
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer 2m 24s
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer 1m
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer 57.5s
tests/trainer/trainer_test.py::TestTrainerToolsSFT::test_trainer_tools 57.6s
tests/trainer/trainer_test.py::TestFullyAsyncMode_0_fsdp::test_fully_async_mode 1m 47s
tests/trainer/trainer_test.py::TestFullyAsyncMode_1_fsdp::test_fully_async_mode 1m 51s
tests/trainer/trainer_test.py::TestFullyAsyncMode_2_megatron::test_fully_async_mode 2m 53s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_0_fsdp::test_trainer 2m 9s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_1_megatron::test_trainer 5m 31s
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer 1m 21s
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer ⏭️ 810ms
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer ⏭️ 808ms
tests/trainer/trainer_test.py::TestTrainerLoRA::test_trainer 3m
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_equivalent 15ms
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_ground_truth 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_solution_string 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_multiple_boxed_answers_in_solution 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_not_boxed 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_raw_and_ground_truth_boxed_equivalent 1ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_extract_answer 4ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_verify_math_answer 73ms
tests/utils/eval_utils_test.py::TestEvalUtils::test_is_equiv 6ms
tests/utils/log_test.py::LogTest::test_actor_log 5.0s
tests/utils/log_test.py::LogTest::test_group_by_node 4.8s
tests/utils/log_test.py::LogTest::test_no_actor_log 898ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_0__workspace_tests_utils_plugins 91ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_1_tests_utils_plugins 89ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_0__workspace_tests_utils_plugins 22.3s
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_1_tests_utils_plugins 22.0s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_0__workspace_tests_utils_plugins 11.9s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_1_tests_utils_plugins 11.6s

Github Test Reporter by CTRF 💚

@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 3, 2025

/unittest-module-common

@github-actions
Copy link

github-actions bot commented Nov 3, 2025

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
33 33 0 0 0 0 4m 55s

Tests

Test Name Status Flaky Duration
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 40.6s
tests/common/config_test.py::TestConfig::test_config_flatten 39ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 421ms
tests/common/config_test.py::TestConfig::test_default_workflow 87ms
tests/common/config_test.py::TestConfig::test_load_default_config 3.3s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly 88ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster 1.9s
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion 15ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 51.8s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 31.7s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 43.4s
tests/common/vllm_test.py::TestModelLen_0::test_model_len 17.3s
tests/common/vllm_test.py::TestModelLen_1::test_model_len 17.0s
tests/common/vllm_test.py::TestAPIServer::test_api 22.7s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async 23.0s
tests/common/vllm_test.py::TestTokenizer::test_action_mask 237ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools 237ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 19.8s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 17.7s

Github Test Reporter by CTRF 💚

@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 3, 2025

/unittest-module-buffer

@github-actions
Copy link

github-actions bot commented Nov 3, 2025

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
32 32 0 0 0 0 2m 9s

Tests

Test Name Status Flaky Duration
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline 27.9s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation 16.1s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer 3.9s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft 6.1s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo 6.4s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader 153ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer 4.2s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter 534ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter 479ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter 803ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter 1.0s
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter 743ms
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter 226ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse 9.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity 4.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control 6.7s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue 5.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue 5.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity 6.5s
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage 5ms
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_buffer_read_write 4.6s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0 182ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1 158ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2 157ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3 162ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4 178ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0 68ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1 4.1s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2 47ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3 3.8s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4 49ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5 4.5s

Github Test Reporter by CTRF 💚

@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 3, 2025

/unittest-all

@github-actions
Copy link

github-actions bot commented Nov 3, 2025

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
172 169 0 3 0 0 1h 12m

Skipped

Tests Status
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer skipped ⏭️

Tests

Test Name Status Flaky Duration
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_std_grpo 40ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_duplicate_grpo 5ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_advantage 3ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_correct_bias 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_reward_std 1ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_with_std_threshold 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_dpo_policy_loss 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_gspo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_mix_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_opmd_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_ppo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_sft_policy_loss 1ms
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline 19.4s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation 15.5s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer 3.9s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft 5.8s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo 6.7s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader 453ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer 4.1s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter 525ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter 461ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter 785ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter 976ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter 754ms
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter 224ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse 8.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity 4.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control 6.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue 5.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue 5.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity 6.3s
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage 5ms
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_buffer_read_write 4.5s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0 181ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1 158ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2 158ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3 162ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4 178ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0 67ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1 3.9s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2 48ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3 3.9s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4 47ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5 4.4s
tests/cli/launcher_test.py::TestLauncherMain::test_debug_mode 45.8s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_command 6.5s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_in_dlc 1.4s
tests/cli/launcher_test.py::TestLauncherMain::test_main_studio_command 339ms
tests/cli/launcher_test.py::TestLauncherMain::test_multi_stage_run 1.7s
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 32.5s
tests/common/config_test.py::TestConfig::test_config_flatten 38ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 187ms
tests/common/config_test.py::TestConfig::test_default_workflow 88ms
tests/common/config_test.py::TestConfig::test_load_default_config 3.2s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly 89ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster 354ms
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion 17ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 52.7s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 32.3s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 44.3s
tests/common/vllm_test.py::TestModelLen_0::test_model_len 17.2s
tests/common/vllm_test.py::TestModelLen_1::test_model_len 17.1s
tests/common/vllm_test.py::TestAPIServer::test_api 22.5s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async 22.3s
tests/common/vllm_test.py::TestTokenizer::test_action_mask 268ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools 237ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 20.0s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 17.7s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer 1m 7s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer 56.3s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer 3m 38s
tests/explorer/explorer_test.py::ServeTest::test_serve 1m 20s
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow 12.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations 12.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results 30.9s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution 12.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow 13.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods 22.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop 24.0s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks 15.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid 12.8s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all 15.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch 21.1s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0 2ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1 602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1 1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps 1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow 16ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow 25ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow 266ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow 4ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow 17ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow 10ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow 80ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1 101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1 201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow 14.5s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow 14.7s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter ⏭️ 1ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner 297ms
tests/manager/synchronizer_test.py::TestSynchronizerExit::test_synchronizer 59.8s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_0::test_synchronizer 1m 45s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_1::test_synchronizer 1m 45s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_2::test_synchronizer 2m 27s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_3::test_synchronizer 2m 34s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_0::test_synchronizer 1m 44s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_1::test_synchronizer 1m 44s
tests/service/data_juicer_test.py::TestDataJuicer::test_config 814ms
tests/service/data_juicer_test.py::TestDataJuicer::test_server_start 21.6s
tests/service/data_juicer_test.py::TestDataJuicerExperiencePipeline::test_data_juicer_operators 31.5s
tests/service/data_juicer_test.py::TestDataJuicerTaskPipeline::test_data_juicer_task_pipeline 14.4s
tests/trainer/trainer_test.py::TestTrainerCountdown_0_fsdp::test_trainer 2m 44s
tests/trainer/trainer_test.py::TestTrainerCountdown_1_megatron::test_trainer 4m 58s
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer 1m 19s
tests/trainer/trainer_test.py::TestTrainerGSM8K_0_fsdp::test_trainer 1m 17s
tests/trainer/trainer_test.py::TestTrainerGSM8K_1_fsdp2::test_trainer 1m 17s
tests/trainer/trainer_test.py::TestTrainerGSM8K_2_fsdp::test_trainer 1m 21s
tests/trainer/trainer_test.py::TestTrainerGSM8K_3_fsdp2::test_trainer 1m 30s
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer 2m 24s
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer 1m
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer 57.8s
tests/trainer/trainer_test.py::TestTrainerToolsSFT::test_trainer_tools 57.2s
tests/trainer/trainer_test.py::TestFullyAsyncMode_0_fsdp::test_fully_async_mode 1m 49s
tests/trainer/trainer_test.py::TestFullyAsyncMode_1_fsdp::test_fully_async_mode 1m 50s
tests/trainer/trainer_test.py::TestFullyAsyncMode_2_megatron::test_fully_async_mode 2m 51s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_0_fsdp::test_trainer 2m 14s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_1_megatron::test_trainer 5m 34s
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer 1m 21s
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer ⏭️ 809ms
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer ⏭️ 807ms
tests/trainer/trainer_test.py::TestTrainerLoRA::test_trainer 3m 21s
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_equivalent 15ms
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_ground_truth 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_solution_string 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_multiple_boxed_answers_in_solution 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_not_boxed 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_raw_and_ground_truth_boxed_equivalent 1ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_extract_answer 4ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_verify_math_answer 74ms
tests/utils/eval_utils_test.py::TestEvalUtils::test_is_equiv 6ms
tests/utils/log_test.py::LogTest::test_actor_log 5.1s
tests/utils/log_test.py::LogTest::test_group_by_node 4.8s
tests/utils/log_test.py::LogTest::test_no_actor_log 899ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_0__workspace_tests_utils_plugins 91ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_1_tests_utils_plugins 89ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_0__workspace_tests_utils_plugins 21.9s
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_1_tests_utils_plugins 22.1s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_0__workspace_tests_utils_plugins 12.0s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_1_tests_utils_plugins 11.6s

Github Test Reporter by CTRF 💚

@chenyushuo chenyushuo merged commit 43531d6 into modelscope:main Nov 4, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants